@skmoore Would you mind adding one counterexample that has an invalid value for num_floors_underground and uses the ext_expected_exception property to verify that the right validation exception is generated?

I added a counter example, but I cannot generate the proper expected exception?

@skmoore Would you mind adding one counterexample that has an invalid value for num_floors_underground and uses the ext_expected_exception property to verify that the right validation exception is generated?

I added a counter example, but I cannot generate the proper expected exception?

Can you help me understand what actions you did, and how the actual result different from your expectation?

The way I usually do this is:

1. Add ext_expected_exceptions: ["some nonsense"]
2. Run ./test.sh -m counterexamples "path/to/your/counterexample.yaml.
   • The test run should fail and print detailed output.
   • The reason it fails is because none of the failure outputs match the text "some nonsense".
3. Look at the output.
   • Make sure there aren't any unexpected failures... If there are, the counterexample has another issue that needs fixing.
   • Find the expected failure line in the output.
4. Replace "some nonsense" with a useful substring from the expected failure line.
5. Repeat step 2, which should pass now.